P-869 

5-21-56 

-1- 


3UMMART 


In  this  paper  It  is  shown  that  a  combination  of  the  clas¬ 
sical  Lagrange  multiplier  formalism  and  the  functional  equation 
technique  of  dynamic  programming  enables  j»s~t»-- treat*  a  number 
of  types  of  variational  problems  involving  the  computation 

tr,  6 

and  tabulation  of  functions  of  N  variables  by  computing  first 

A 

sequences  of  functions  of  K  variables,  and  then  sequences  of 
functions  of  PMC  variables,  where  1C  may  be  chosen  within  the 
range  1X^K  cmi.  The  choice  of  K  depends  upon  the  process. 

This  reduction  in  the  dimensionality  of  the  functions  in^- 
volved  is  equivalent  to  an  increase  in  the  capability  of  modern 
digital  computers  as  far  as  dynamic  programming  processes  are 

concerned.  (  )  / 
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DYNAMIC  PROORAMMINO  AND  LAQRANQE  MULTIPLIERS 
1 .  INTRODUCTION 

"  • 

The  purpose  of  thie  note  Is  to  Indicate  how  a  suitable 
combination  of  the  classical  method  of  the  Lagrange  multiplier 
and  the  functional  equation  method  of  the  theory  of  dynamic  pro¬ 
gramming1  can  be  used  to  solve  numerically  and  treat  analytically 
a  variety  of  variational  problems  that  cannot  readily  be  treated 
by  either  method  alone. 

A  series  of  applications  of  the  method  presented  here  will 
appear  in  further  publications. 


2.  FUNCTIONAL  EQUATION  APPROACH 


Consider  the  problem  of  maximizing  the  function 

N 

#Xg * . . .  »Xjj)  • 


(2.1) 


subject  to  the  constraints 

N 

(a)  £  &ij (Xj )  <  ^i*  ^  “  1,2,... ,M, 
J  *  1 

(b)  ^  0# 


(2.2) 


where  the  functions  gj^x)  are  taken  to  be  continuous  for 

x  2  0,  and  monotone  increasing.  Por  c^  >  0,  define  the  sequence 
of  functions 

fN(cl»c2»...»cM)  -  Max  P(x1,x2,...,xN) 

for  N  ^  1 • 

Then  f ^ (c^,Cg, . . .,0^)  is  determined  immediately,  and,  employing 
the  principle  of  optimality,1  we  obtain  the  recurrence  relation 
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fk+l*cl'c2**,*'cl|)"  **“  tgk+l^x^+fk^cl“Al,k+l^x^***»clTSl,k+l^x^3 

(2.„ 

for  k  -  1,2,..., N-l. 

Due  to  the  limited  memory  of  present-day  digital  computers, 
this  method  founders  on  the  reef  of  dimensionality  when  II  £  4 . 

If  we  wish  to  treat  applied  problems  of  greater  and  greater  realism, 
we  must  develop  methods  capable  of  handling  problems  Involving 
higher  dimensions . 

In  this  paper  we  shall  present  one  method  of  overcoming  these 
dimensionality  difficulties . 


5.  FUNCTIONAL  EQUATIONS  AND  LAQRANQB  MULTIPLIERS 


The  method  of  the  Lagrange  multiplier  In  classical  variational 
theory  consists  of  forming  thp  function 


N  N  N 

^(x1,x2,...,xN)  -  g1(x1)  -  )  #  (5.1) 

where  the  * ^  are  parameters  determined  subsequently  by  means  of 
(2.2),  and  then  utilizing  a  direct  variational  approach  on  this 
new  function. 

Vie  shall  employ  an  approach  intermediate  between  this  method 
and  the  method  sketched  in  $2. 

Consider  the  function 


F(x 


j  *  * 


’V 


"  i-181^  ~i?i  ^ 


where  1  ^  K  ^  M-l .  We  wish  to  maximize  this  function  over  the 
region  defined  by  the  constraints 
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(*) 


M 

i  v 1 


K+1,...,M, 


(b)  xL  ^  0. 


(3.3) 


Tor  fixed  values  of  the  A^,  we  have  a  problem  of  precisely 
the  type  discussed  in  §2,  with  the  advantage  that  we  now  require 
functions  of  degree  M-K  for  a  computational  solution. 

Once  the  sequence  {$N(  cK+i**..*ci(i  A2,...,  Aj^N  •  1,2,..., 


<WCK+1'*,*»CN;  Xl»  A2'***»  ^  P(x1»*2,,,,,XN;  Al»  X2»“'AK^ 

(3.4) 

has  been  computed,  we  vary  the  parameters  A^  to  determine  the 
range  of  the  parameters  c^yCg, . . .,c^. 

We  have  thus  partitioned  the  computation  of  the  original 
sequence  cf  functions  of  M  variables  into  the  computation  of  a 
sequence  of  functions  of  K  variables,  followed  by  the  computation 
of  a  sequence  of  functions  of  M-K  variables.  Hie  choice  of  K  will 
depend  upon  the  process. 

There  are  a  number  of  rigorous  details  which  we  will  discuss 
elsewhere . 


4.  SUCCESSIVE  APPROXIMATIONS 

Since  the  Lagrange  multipliers  are  intimately  connected  with 
"marginal  returns"  or  "prices,"  In  a  number  of  applied  problems  we 
begin  with  a  certain  hold  on  the  process  as  far  as  approximate 
solutions  are  concerned.  Iterative  techniques  based  upon  this 
observation,  and  the  connection  with  optimal  search  procedures  will 
be  discussed  elsewhere. 


5.  APPLICATION  TO  THE  CALCULUS  OP  VARIATIONS 
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In  the  theory  of  control  processes,^  one  encounters  a 
problem  such  as  that  of  minimizing  a  non-analytic  functional 
such  as 

T 

J  (u)  -  f  |l-u|dt  (5.1) 

0 

over  all  functions  v(t)  satisfying  the  constraints 


(a)  -kj  <  v(t)  ^  k2,  0  <  t  ^  T, 

T 

f  I v(t) |dt  <  c. 
o 

where  u  and  v  are  connected  by  a  relation 


(5.2) 


-  s(u,t,v),  u(0)  -  a.  (5.?) 

Replacing  Jj(u)  by 

T  T 

J2(u)  ■/  il-u|dt+>  /  |v(t)|dt  (5.4) 

o  o 


A  2,  0,  we  can  employ  functions  of  two  variables  in  determining 

the  analytic  or  numerical  solution,  rather  than  functions  of  three 
2 

variables;  cf.  .  This  reduction  by  one  in  dimensionality  results 
simultaneously  in  a  tremendous  saving  in  computing  time,  and  in 
a  great  Increase  in  accuracy  of  the  numerical  results. 


*  R.  Bellman,  The  Theory  of  Dynamic  Programming,  Bull.  Amer.  Nath. 

Soc.,  vol.  60(1954),  pp  505-516. 
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